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Abstract: Background: Depression goes often unrecognised and untreated in non-psychiatric medical settings. Screening 
lias recently gained acceptance as a first step towards improving depression recognition and management. The Primary 
Care Screener for Affective Disorders (PC-SAD) is a self-administered questionnaire to screen for Major Depressive Dis- 
order (MDD) and Dysthymic Disorder (Dys) which has a sophisticated scoring algorithm that confers several advantages. 
This study tested its performance against a 'gold standard* diagnostic interview in primary care. 

Methods: A total of 416 adults attending 13 urban general internal medicine primary care practices completed the PC- 
SAD. Of 409 who returned a valid PC-SAD. all those scoring positive (N™ 1 5 1 ) and a random sample (N 1 06) of those 
scoring negative were selected for a 3-month telephone follow-up assessment including the administration of the Struc- 
tured Clinical Interview for DSM-1V-TR Axis 1 Disorders (SCID-1) by a psychiatrist who was masked to PC-SAD results. 

Results: Most selected patients (N-212) took part in die follow-up assessment. After adjustment for partial verification 
bias the sensitivity, specificity, positive and negative predictive value for MDD were 90%, 83%. 51%. and 9K%. For Dys. 
the corresponding figures were 78%, 79%. 8%, and 88%. 

Conclusions: While some study limitations suggest caution in interpreting our results, this study corroborated die diagnos- 
tic validity of the PC -SAD, although the low PPV may limit its usefulness widi regard to Dys. Given its good psychomet- 
ric properties and the short average administration time, die PC -SAD might be the screening instrument of choice in set- 
tings where die technology for computer automated scoring is available. 
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INTRODUCTION 

Depressive disorders arc relatively common in the gen- 
eral population [I) and arc the fourth leading cause of 
worldwide disease burden, as they account for 12% of all 
total years lived with disability [2). The cost of depression 



'Address correspondence to this author at the Italian National Institute of 
Health. Centre of Epidemiology. Surveillance, and Health Promotion. Men- 
tal Health Unit. Vialc Rcgina Elena, 299-00161 Rome, Italy; 
Tel: *39 06 49904200; Fax: +39 06 49904182; E-mail angclopkardi(ojiss.il 

'The SET-DEP Group includes: A. Picardi. M. Biondi. M. Ccrbo. A. Gaddi- 
ni. A. <iigantcsco. F. Spandonaro. M. Caredda. A. Cavallo. A. Crcsccnzi. I. 
Lega. G. Martcucci. H. Pohstcna. L. Tarsitam. M.P. Zerella. I. Berardclli. I. 
Cascavilla. D. Del Re. C Fini, L. Lconcini. S. Baccarini. P. D'Andrca. M. 
Di Fonso. R. Dolfi, A. Gucrani. D. Mandolini. (i. Mam. L. Pagano, M. 
Paglianni. M.L. Paolcttl. A. Pes. S. Raspa. M. Sabatini. U. Salomonc. P. 
Ventura. 



has been estimated at S83.I billion in the USA [3) and £9 
billion in England [4], most of which was attributable to time 
off work. In primary care [5], as well as in other non- 
psychiatric medical settings [6], their prevalence is high. In 
the PREDICT study carried out in six European countries, 
the 12-month cumulative incidence of DSM-IV major de- 
pression in screened GP attendees was 7.7% [7]. 

Given that effective treatments arc available, the impor- 
tance of their early detection and treatment cannot be over- 
stated and indeed several authors have called for the better 
identification and treatment of depression [8). Primary care 
physicians arc often the first, and not rarely the only, health 
professionals that arc contacted by depressed patients [9J. 
However, the accuracy of depression recognition by primary 
care practitioners and other non -psychiatrist physicians is not 
satisfactory [10, II]. Hence, improving diagnostic efficiency 
for depressive disorders in primary care and other non- 
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Fig. (1). Flow chart of the study. 

psychiatric medical settings is an important public health 
objective. 

In recent years, screening for depression in non- 
psychiatric medical settings has gained acceptance as a first 
step towards improving depression recognition and man- 
agement [12], and several screening tools have been devel- 
oped. However, not all depression screcners arc suitable for 
routine use [13, 14]. Lengthy self- administered question- 
naires as well as clinician-administered instruments arc im- 
practical, while the instruments that do not provide clinicians 
with a list of the symptoms of depression that arc present in 
each case make physician follow-up more difficult and time- 
consuming. Instruments such as the 9-itcm Patient Health 
Questionnaire (PHQ-9), a short questionnaire that is worded 
closely after the DSM-IV summary criterion for each MDD 
symptom, constitute a better approach to the problem. How- 
ever, even the PHQ-9 has a limitation in the complexity of 
various items. Given that the instrument uses a single item to 
inquire about both polarities of vegetative symptoms, it in- 
cludes several multiple concept questions that require the 
patient to integrate various emotions and behaviours into a 
summary answer, which may put less-educated subjects into 
some trouble. 

The Primary Care Scrccncr for Affective Disorders (PC- 
SAD) [14] is a 37-itcm self-administered questionnaire de- 
signed to screen for Major Depressive Disorder (MDD) and 
Dysthymic Disorder (Dys) in primary care. It makes use of 
technological advances [IS] and has a sophisticated scoring 
algorithm that confers several advantages, such as the possi- 
bility to yield valid results even if many items arc left unan- 
swered. Its validity was first tested against other established 
screening questionnaires in health plan members, primary 
care outpatients, and psychiatric patients [14], and then was 
tested against a standardised psychiatric interview in dcrma- 



tological inpatients [16]. Also, valid and reliable continuous 
measures of depression severity derived from the PC-SAD 
arc available [17, 18]. However, no study has yet validated 
the PC-SAD against a standardised diagnostic interview in a 
primary care setting. This study aimed at filling this research 
gap by testing the performance of the PC-SAD against a 
"gold standard' diagnostic interview in a sample of primary 
care patients. 

METHODS 

Patients and Procedure 

A convenience patient sample consisting of adults attend- 
ing 13 urban general internal medicine primary care prac- 
tices took part in this diagnostic validity study. Participants 
were recruited by fliers posted in the waiting room while 
attending their regular appointments. They were offered to 
participate in a program for early detection of depression 
called 'SET-DEP' (Screening and Enhanced Treatment for 
Depression) and they provided written informed consent to 
participate in the study according to procedures approved by 
the Italian National Institute of Health ethical committee. 

Fig. (I) shows the (low of patients through the study. A 
total of 416 primary care patients aged 18-65 years were 
included in the study and completed the PC-SAD in the wait- 
ing room. Only 7 PC-SAD questionnaires were unusable 
because of missing answers. Of the 409 participants with a 
valid PC-SAD, 121 were positive for MDD, either with 
(N=6 1) or without (N=60) positivity also for Dys, and 30 for 
Dys alone. The remaining 258 participants were negative for 
both MDD and Dys. 

All patients with a positive PC-SAD result and a random 
sample of 41% (N=106) of those scoring negative on the PC- 
SAD were selected for a follow-up mental health assessment 
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to be performed by telephone by a psychiatrist three months 
after PC-SAD completion, which included the Structured 
Clinical Interview for DSM-IV-TR Axis 1 Disorders, Re- 
search Version, Patient Edition (SCID-I) [18]. Two psychia- 
trists performed the follow-up assessments. Of 151 patients 
scoring positive on the PC-SAD, 132 (81% females, mean 
age 47.4±l I.5J were administered the SCID-I, while 8 could 
not be contacted despite repeated attempts and 1 1 refused the 
follow-up interview. Of the 19 patients with a positive PC- 
SAD who did not undergo the follow-up assessment, 1 1 
were positive for MDD, either with (N"=6) or without (N=5) 
positivity also for Dys, and 8 for Dys alone. There were no 
differences in gender, age, education, or marital status be- 
tween the patients who underwent the follow-up assessment 
and those who did not. Of the 106 patients with a negative 
PC-SAD result sampled for the follow-up assessment, 80 
(69% females, mean age 45.0±1 1.3) were administered the 
SCID-I, while 22 could not be contacted despite multiple 
attempts and 4 refused the follow-up interview. There were 
no differences in demographic variables between the patients 
who were administered the follow-up interview and those 
who did not, except for a higher mean age in patients who 
did not take part in the follow-up assessment. 

Instruments 

The SCID-I [19] is a clinician-administered detailed 
semi-structured interview that covers most Axis I disorders 
and is regarded as the 'gold standard* for making DSM-IV 
diagnoses. Several studies showed the superior validity of 
the SCID-I over standard clinical interviews at intake epi- 
sode [20, 2 1 J. 

The PC-SAD [14] is a short, self-administered question- 
naire, constructed in accordance with DSM-IV criteria. The 
PC-SAD makes it possible to screen not only for MDD but 
also for Dysthymic Disorder (Dys). It consists of a 3-itcm 
prc-scrccncr (two MDD questions and one Dys question, 
which arc part of the scrccncr score but reduce respondent 
burden by terminating the questionnaire if all arc negative), a 
26-item MDD section, and an 8-itcm Dys section. The PC- 
SAD breaks down each of the nine DSM-IV symptoms of 
MDD into several simple items, each consisting of single 
concept questions, and it integrates the answers mathemati- 
cally. The responses linked to a given symptom arc num- 
bered and summed, and if the sum is above a certain thresh- 
old, the patient is said to have the symptom. The question- 
naire is scored using an automated system, and the scoring 
algorithm is built in a way that the presence of each symp- 
tom can be determined independently from the presence of 
missing answers to one or more items related to the symp- 
tom, provided that at least one of the items related to the 
symptom has been answered. Hence, the questionnaire can 
give valid results even if many items arc left unanswered, 
provided that at least one item for each DSM-IV symptom is 
answered. Similarly for the Dys section, which is the only 
validated self-administered scrccncr available that is specific 
for Dys. 

Performance of the Screening Test 

Using the SCID-I as the reference standard, we calcu- 
lated the sensitivity, specificity, predictive values, and likcli- 
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hood ratios of the PC-SAD for MDD and Dys. Sensitivity is 
defined as the proportion of individuals with a disease who 
have a positive test result, whereas specificity is the propor- 
tion of individuals without the disease who have a negative 
test result. The positive predictive value (PPV) is the per- 
centage of patients with a positive test result who have the 
disease, while the negative predictive value (NPV) is the 
percentage of patients with a negative test result who are free 
from the disease. The likelihood ratio for a positive result 
represents the odds that a patient with the disease has a posi- 
tive test result as compared w r ith a patient without the dis- 
ease. The likelihood ratio for a negative result represents the 
odds that a patient without the disease has a negative test 
result as compared with a patient without the disease. Differ- 
ently from predictive values, sensitivity and specificity arc 
largely independent of the setting in which a screening test is 
used as they arc quite stable with changes in prevalence of 
the disease in the population, while likelihood ratios may be 
even more stable w r ith changes in prevalence [22]. 

Adjustment for Partial Verification Bias 

In studies where only a portion of patients who under- 
went the screening test arc administered the reference stan- 
dard, the estimates of sensitivity and specificity may be bi- 
ased. The term partial verification bias is commonly used to 
describe the quantitative effect of having different fractions 
of patients with a positive and negative screening result re- 
ceiving the reference standard. Usually, this kind of bias 
leads to overestimate sensitivity and underestimate specific- 
ity [23]. 

To adjust for partial verification bias in patients with a 
PC-SAD positive for depression, we relied on the missing at 
random assumption, i.e., that the decision to ascertain the 
presence of depression docs not depend on any information 
related to true disease status other than the observed PC- 
SAD result. This assumption is reasonable as the patients 
with a negative PC-SAD who were administered the SCID-1 
were randomly selected from the full sample of test nega- 
tives, and only a small proportion (12.6%) of patients with a 
positive PC-SAD did not receive the SCID-I. 

Under this assumption, to adjust for partial verification 
bias the observed test results in each test stratum are 
weighted by the probability that patients in that stratum were 
administered the SCID-I [24]. As positivity to MDD or Dys 
may be a measured cofactor that influenced test verification, 
the patients with a PC-SAD negative for MDD who did not 
receive the SCID-I were further stratified according to their 
positivity for Dys or not, and the patients with a PC-SAD 
negative for Dys who did not receive the SCID-I were fur- 
ther stratified according to their positivity for MDD or not. 
Then, the adjustment was made weighted according to cofac- 
tor-defined strata to derive unbiased estimates of sensitivity 
and specificity. 

RESULTS 

The results of the follow-up assessment, performed on 
1 32 patients scoring positive and 80 scoring negative on the 
PC-SAD, arc described in detail in Table I. 

Of 1 10 patients scoring positive for MDD, 56 received a 
SCID-I diagnosis of MDD. and 35 of another mental disor- 
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dcr, while only 19 had no diagnosablc menial disorder. Of 22 
palicnis scoring negative for MDD but positive for Dys, 5 
had MDD as determined by the SCID-I. All 80 patients scor- 
ing negative for both MDD and Dys were free from MDD as 
determined by the SCID-I. 

Of 77 patients scoring positive for Dys, 6 received a 
SCID-I diagnosis of Dys, 44 had another depressive disor- 
der, 6 an anxiety disorder, and only 21 had no diagnosablc 
mental disorder, of whom one had symptoms of grief in re- 
sponse to a recent loss. Of 55 patients scoring negative for 
Dys but positive for MDD, 2 had Dys as determined by the 
SCID-I. All 80 patients scoring negative for both Dys and 
MDD did not receive a SCID-I diagnosis of Dys. 

Most patients with a negative PC-SAD (N=63, 80%) did 
not receive any DSM-IV diagnosis, while the remaining 17 
were diagnosed with a mental disorder, in most cases (N=I5) 
an anxiety disorder. 

The performance of the PC-SAD after adjustment for 
partial verification bias is presented in detail in Tabic 2. 

DISCUSSION 

Consistently with previous findings on dennato logical 
patients [16], the PC-SAD displayed excellent sensitivity and 
good specificity for the diagnosis of MDD as determined by 
the SCID-I. Also, both the likelihood ratio positive and like- 
lihood ratio negative were better than the median values re- 
ported for other instruments [25]. The NPV was very high 
and the PPV was also quite high, as compared with the usual 
scenario where most patients screening positive do not have 
MDD 126]. It should be noted that the PPV is partly depen- 
dent on the prevalence of the condition in the population 
being tested, and that the prevalence of depressive disorders 
in our sample was relatively high, likely due to the fact that 
patients sclf-sclcctcd for participation in the study. Under a 
scenario of 8% prevalence, consistent with epidemiological 
studies performed in primary care settings [7, 27J, the PPV 
would be 31%. On the other hand, in general medical set- 
tings where all patients arc ill and a substantial proportion 
have a chronic physical health problem the prevalence of 
depression is estimated to be as high as 24% [28], and under 
such a scenario the PPV would be 62%. 

The MDD/Dys ratio as based on PC-SAD positive scre- 
ens for MDD and Dys was similar to that found in the Work 
and Health study [29]. With regard to SCID-bascd diagno- 
ses, consistently with the finding of a much higher preva- 
lence of MDD as compared with Dys (3:1 ratio) in the Italian 
general population [30], Dys was much less common than 
MDD in our patient sample. With respect to Dys, sensitivity 
and specificity were fairly satisfactory, as were likelihood 
ratios and the NPV. The PPV was particularly low and 
clearly not satisfactory, although, as also observed in our 
previous study [16], many false positives, despite not having 
a diagnosis of Dys, were actually affected by another depres- 
sive condition, so that a positive result for Dys retains clini- 
cal value as it suggests the possible presence of a depressive 
disorder. A possible explanation for the low PPV for Dys is 
that the wording of the Italian version is such that patients 
may too easily indicate the presence of symptoms. Although 
a future study testing the English version of the PC-SAD 



against the SCID-I would be necessary to rule out this expla- 
nation, critical examination of the relevant Italian items sug- 
gests that wording is unlikely to account for the finding of a 
low PPV for Dys. More likely, this finding reflects difficul- 
ties inherent in the diagnosis of Dys itself. In fact, with any 
self-report instrument, no matter how sophisticated, it is e- 
xtrcmcly difficult to establish the co-occurrence of several 
depressive symptoms for most days over a very long period 
of time, and it is impossible to distinguish between the long- 
lasting depressive symptoms of chronic MDD or MDD in 
partial remission and those of MDD comorbid with Dys. 
Moving the !*<- SAD cut off lor Dys ma) help reducing Uhe 
number of false positives, but would hardly solve the pro- 
blem given the difficulties involved in questionnaire-based 
diagnosis of Dys. Possibly, the PC-SAD section on Dys 
might be renamed as 'chronic depressive symptoms* so as to 
retain its clinical worthiness without formal diagnostic im- 
plications, given also that the nosology of chronic depression 
is complex and has long been a matter of controversy [31, 
32]. Future studies arc needed to fully elucidate this issue. 

This study has sonic limitations. First, not all patients 
whose PC-SAD result was negative were administered the 
reference standard due to cost considerations. However, 
given the high sampling fraction and the use of random sam- 
pling, there is reason to believe that the missing at random 
assumption was satisfied, and that the adjustment for partial 
verification yielded unbiased estimates of sensitivity and 
specificity. Second, patients volunteered for participation in 
the study, which likely led to an increased prevalence of de- 
pression as compared to the prevalence in all patients attend- 
ing the primary care practices. While this likely accounts for 
the finding of a particularly high PPV for MDD, the esti- 
mates of sensitivity, specificity, and likelihood ratios arc 
reliable as these test properties arc relatively unaffected by 
changes in disease prevalence. Third, the patients were as- 
sessed by telephone rather than facc-to-facc interviews. 
However, several studies using standardized psychiatric in- 
terviews have obtained moderate to good diagnostic agree- 
ment between telephone and in-pcrson administration [33- 
36]. Fourth, the time elapsed between PC-SAD completion 
and SCID-I administration may have led to missing some 
depression diagnoses. However, the SCID-I allows reliable 
retrospective psychiatric diagnoses and the 3-month follow- 
up interval was so short to make undcrdiagnosis of a recent 
depressive episode quite unlikely. At any rate, if some de- 
gree of underdiagnosis occurred, its impact on the results 
would have been conservative as it would have led to under- 
estimate the performance of the PC-SAD. 

While these limitations suggest some caution in interpret- 
ing our results, this study is the first to provide evidence of 
validity against a 'gold standard* for the PC-SAD in primary 
care patients, and corroborated the notion that the PC-SAD 
is a sensitive and specific screening tool for MDD and Dys, 
although the low PPV displayed for the latter disorder may 
limit its usefulness with regard to Dys. 

While depression screening alone is insufficient to substan- 
tially improve patient outcomes and should be supplemented 
by physician case management or mental health 
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Table 1. Sociodemographic and Clinical Char&cterlstkl of Patients Undergoing the Follow-Up Assessment 
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specialist involvement in order to assure accurate diagnosis, 
effective treatment, and careful follow-up [12]. the availabil- 
ity and use of simple, practical, reliable and valid depression 
scrcencrs is a key first step in any depression screening and 
management program. Many questionnaires arc available to 
screen for depression in primary care and other non- 
psychiatric medical settings [25, 28, 37-40]. The selection of 
a scrcencr requires consideration of several issues, such as 
characteristics of the population being screened, psychomet- 
ric properties of the scrcencr, time required to complete and 
to score the measure, case of use, and cost. Given its high 
sensitivity and specificity, the short average administration 
time owing to the 3-itcm pre-scrccncr, and the possibility to 
screen not only for MDD but also for Dys if desired, the PC- 
SAD might be the instrument of choice in settings where the 
technology for computer automated scoring is available. 
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